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ABSTRACT . 

The "Infinity Factory" television series was 
developed to help children ages 8 through 11 to understand the 
usefulness of some basic mathematics skills for everyday life. Aimed 
primarily at black and Latino children, the series concentrates on: 
the decimal number system; measurement, especially the metric system; 
estimation; mapping an4 scaling; and graphing. Throughout the series 
there is^ emphasis on creative problem solving techniques, and on a 
positive student self-image. An evaluation of eight of the programs 
was conducted using 1,000 students and their teachers in 39 3rd-6th 
grade classes in four cities as subjects. The evaluation measured 
student attention, appeal of the overall programs and major segments 
of each program, student comprehension of stqjry line and gains in 
math skills, attitudes toward math, social attitudes, apd teachers' 
opinions of the effectiveness and usefulness of the series. This 
report gives, a detailed analysis of the evaluation of the series 
taken a,s a whole. (JY) 
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1 . INTRODUCTION 



"Infinity Factory" is a television series about 
mathematics, people, and people using math. The series 
was produced by Education Development Center, Newton, 
Mass., under a grant , from the U.S.' Office of Education, 
ESAA, witli additional start-up support from the Qamegie 
Corporation of New York, John and Mary R. Markle Foundation, 

^DR 3rd Fund, National Science Foundation, and Alfred. P. 
Sloan Foundation. Designed for both home and classroom 
viewing, the series presents mathematics in a .common-sense 
way tha't helps children understand the usefulness of math- 
ematics in their own lives. The programs are for children 

'ages 8 through 11, especially Black and X-atino children. 
A series' of 52 half-hour programs has been produced and 
is scheduleij^ f^"' broadcasting over the Public Broadcasting 
Service b^ginnipg in the Fall of 1976. 

"Infinity Factory" mathematics concentrates on 
five main areas : 

1. Decimal number j?ystem, including single-digit 
arithmetic and LSchniques for getting rough 
arithmetic answers quickly, such as rounding 
off; 

2. Measurement, with a special emphasis on the 
metric system; 

3. Estimation; 

^ 4. Mapping and scaling, including treatments of 
ratio and proportion; 
5 . Graphing,. 

Intertwined through all the mathematical areas 
are some useful ways^to solve problems: techniques that ^ 
apply to problems in many areas. These methods are pre- 
sented to encourage viewers to think creatively about 
problems they encounter themselves. 



Along with the mathematics, "Infinity Factory" 
addresses a set of cultural and ethnic goals that reflect 
the special needs of minority children in the audience. 
These goals include: 

1. presenting positive Black and Latino role 
models ; 

2. helping each viewer to reinforce good feelings 
about his or her own group, and to accept people 
and relationships in other groups; ^ 

3. reprjBsenting the inner-city ehvironment, both* 
for urban audiences and for suburban and rural 
viewers, in order to present experiences common 
to many members of the target audience; 

A. ^tressing the hiiinanis tic" perspectives of 'sharing, 

cooperation, equality, and self-respect. 
The program follows a magazine format. Each program 
centers around one miin ma^th theme, usually involving two 
or three skills or concepts. Several short segments in 

ach program trteat this mathematical theme from different 
perspectives , developing the mathematics in several related 
ways. These segments show math at work in people's every- 
day lijVes. .. . 

. The major segments of each program are: 

"Scoops' Place" — a live-action, dramatic 
segment about a Black family who runs a neighborhood 
store in New York City. 

"City Flats" -- -also ^live-action, is about a 
Latino family operating a bakery in East Los Angeles. 

- "Brownstone" segments -- a resident multi- 
ethnic cast of young people act in short skits that 
usually take place in and around an urban "Broxfm- 
stone' apartment house built in a television studio. 
^^Mimation segments -- used to present certain 
^-^math concepts in a humorous and direct manner. 
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In addition, every program features a historical 
segment introduced by the "Brownstone'' cast. Each of 
these segments points out an importah\t contribution made 
by a notable minority person, often in a field involving.^ 
mathematics. Some, programs also include "Math in the Street 
interviews, which present spontaneous responses from 
many people to a question about mathematics, 
' In conjunction with the. trial broadcast season of ' 

the "Infinity Factory'' seriea durinj^ the Spring of 1976, 
an evaluation of eight programs was conducted, The evalu- 
ation effort spanned a ten-week period: one week of pre- 
testing, eight weeks of in-school viewing, and a final 
week of posttesting. The program was viewed in' four cities 
in the United States. Over 1,000 students and their teach- 
ers in 39 third-to-sixth-grade classes participated in the 
study. ^ , • 

. The objectives of the evaluation were: 

1. to determine student attention to the programs; 
.2. to determine the appeal of the overall programs 
and of the major segments of each program to 
both .st\idents and teaches; 

3. to determine student comprehension of the ' ' 
dramatic story lines; 

4. to determine the degree^to which the eight- 
program "mini-series'' met its objectives in 
the areas of learning math content attitudes 
toward math, and social attitudes-p- — ' 



* The eight programs evaluated were: 



Program - Broadcast Number Topic - 



A 


114 


Measurement of Time 


B 


127 


Rounding Off and Approximation 


C 


130 


Measurement of Weight 


D 


131t 


Mapping and Scaling 


E 


103 


Graphing 


F 


123 


Estimation of Quantity 


G 


129 


Measurement of Weight 


H 


132 . 


Mapping and Scaling 



5/ to determine teachers' opinions of the effec- 

^ tiveness of the series and its usefulness in 
the^ classroom. 

THts evaluatitJn report will include two parts,, 
Part I examines the effectiveness of the ^ eight programs 
tdken as a whole through statistical analyses of pretest/ 
posttest differences, subscales based "^n. responses over 
eight programs, and trends over eight programs. In par- 
ticular". Part I focu9ses. on student attention, student 
appeal, students' comprehension of dramatic story lines, 
students' knowledge of math content, students' attitud.es, 
""and teachers' attitudes. , * 

Tart II of the report presents a. descriptive report 
oti each of the eight programs in the areas of student " 
attention, student appeal, teachers' opinions of the 
programs, and the number and kinds of' related classroom 
activities. Abstracts of these reports are contained in 
Appendix A. ' 
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2 > METHOD 



Syibj ects * 

Students and teachers in 39 classes participated 
in the evaluation study- There were 5 classes (n - 131 
students) in Lawrence, Massachusetts ;*13 classes (n - 265) 
in Boston, Massachusetts i 10 classes (n « 319) in Los 
Angeles, California; and 11 classes (n » 327) -in New York, 
New York.. There were 2 third grade classes, 15 fourth 
grade classes, 12 fifth grade classes, and 10 sixth grades 
classes. The study included a total of 562 girls and 480 
boys; Table 2.1 provides a further breakdown according to 

ethnic group,' age, and sex for all studqpts for 
whom complete data were available. (Since the primary 
focus of this evaluation was pn the effectiveness of the 
"Infinity Factory" programs for Black and Latino students, 

students who were white or other minority were pooled into 

J. . 

the category of non- target students.) 

The sample .of 39 teachers was comprised of 8 Black 
women, 2 Latino women, 23 wla^ite women, and 4 white men. 
The teachers had an average of 7^6 years of teaching ex- 
perience. Of thfe 39 teachers, 14 described themselves 
las infrequent users of tnedia (television and other audio- 
visual materials); 11 teachers described themselves 'as 
moderate users of media; and 14 teachers described them- 
selves as frequent users of media. \ 



* A small, industrial city north of Boston^- 



Table 2 a 
Description of Sample Population 



Age 



Group 



Youoger Students Older Students ' Total 



Black Students 
.Boys \ 
■ ' Girls " \^ ' 

Latino Students • 
Boys ' ^ 

Girls 

Non-Target Students 
Boys 
Glr^s 

Total 



122 
lAO 

63 

82 

62 
59 

528 



69 
93 

90 
97 

53 
• 70 

A72 



191 

233 

V 

153 
179 

115 
129 

1000 



Note , n, - A59'. 
-^)oys 



—girls 



5A1. 



^'^Ten years old^ or younger. , 
^Eleven years old or older. 



Experimenters 

In each city, visitors were drawn from local tini- . 
versrcies or sc*hpol systems; and were identified by. contacts 
based 6n their qualification^^ and experieiice working with chil- 
dren.' Whenever possible, visitors were plafced in classrooms^ so 
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that the visitor was from the same ethnic group as the 
majority of students in that class.. However, this was 
possible in only a few cases because most of the classes 
participating in the study were integrated classes. 

In each city, testers were trained to administer^ 
the pre- and posttestSo Tv/o of the testers were eva 
tion project staff members; the other eight testers were 
graduate students drawn from local viniversities in each 
city. ^'\^ ' 

Instruments' 

Two types of instruments, were developed for this 
study: insftruments which were used as pretest/posttest 
measures and instruments which were used weekly. Some 
instruments were completed by the students, some^by the 
teachie.r.,.. and some, b the visitor » Those instruments which 
w^e completed by the visitor provided information on 
students' responses to the programs as well as on the 
ambiant and kinds of related classroom activities which 
took place each week. ^ 

Student instVtments measured: 

1. Appeal of the program; 

2. ' Comprehension of the story line; 
,3., Knowledge of math content; 

4. Attitudes toward television, math, and tele- 
vision programs on math; and - . 

5. A range of social attitudes related to series 
goals. 

Teacher instruments measured general, attitudes and 
reactions to each week's program. 

Visitors monitored students' attention during the 
program viewing; they also observed and recorded the 
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beliaviors of students and teathers before and after program 
viewing, and collected other information about what had 
happened at other times during the week. 

All instrtments which were employed in the evalua- 
tion were'pilot-tested with small groups of target audi- 
ence students. 

Student Attitude Form (Pretest/Posttest) . The I 
first side of the Student Attitude Form examined atti- 
tudes toward television, math, and television programs 
on math .-(see Appendix B) o The tester and students read 
through each item together and students checked boxes if 
they thought each of the concepts was. exciting or boring, 
fvin or no fun, easy or hard, good or bad, and, if they , 
didn't like it or liked it. 

The second side of the Student Attitude Form 
measured a range of attitudes related to the cultural and 
social goals of the serTeSo These incrude'd "attitudes 
toward sex roles, adult-child relationships, self-concept, 
attitudes toward math, attitudes toward one's own culture, 
attitudes toward other cultures, and attitudes toward 
television. - The tester and the" students together read 
through 15 statements; if a student agre'ed with the state- 
ment, he or she circled yes; if a student disagreed with 
the statement, he or she circled no. 

Student Math Content Form (Pretest/Posttest) . The 
first side of the Student Math Content Form .included four- 
teen statements with which the student either agreed (by 
circling yes) or disagreed (by circling no) (see Appendix 
B). These items included stateinents about graphing,' 
measurement of time, rounding off, weight, scaling, esti- 
mation, metric measurement, and mapping. 
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The second side of the. Student Math Content Form • 

rnclu ded six items which asked for free responses to 

questions on rounding off and metric weight. Again the 
tester and students read through the entire instrument 
together. 

o 

o 

Teacher Semantic Differential (Pretest/Posttest) , 
"This instrument examined teachers' attitudes toward 
educational television, math, and television programs 
on math (see Appendix B)# Teachers rated each of 
these three concepts on twenty pairs of bipolar adjec- 
tives, rating them on a seven-point scale. 

Teacher Opinion Form (Posttest only) . After com- 
./p.lcting the Teacher Semantic Differential posttest, tea- 
chers were asked^-to complete the Teacher Opinion Form (see 
Appendix B) . Teachers responded to open-ended questions 
about their opinions on: ''N^ 
1-. their overall impressions of the^ "Infinity 
Factory" series; 

2. those particular parts of the programs which 
were most effective in meeting the objectives 
of the series; 

3. those parts of the programs which were least 
effective; and 

4. ways in which the television programs and 
program guides could be improved. 

Student Weekly Response Form . Each week, immedi- 
ately following viewing Of "Infinity Factory," students 
completed a Student Weekly Response Form (see Appendix 
C) . The first side of this instrument measured student 
appeal for the show overall and for the "Browne tone" 
■segments, "City Flats," "Scoops' Plage, " and- animation. 
Tt^e visitor and students read through the entire 
instriiment together and students checked boxes if they 

15 
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^^Jxought a specific segment was, hard or easy, good or no 
^^od^ fxjxi or no fun, too long or too short, and too fast 

too sl^^^ determined in the posttesting session 

^Hat the ite^ "too long or too short," and "too fast or 
^^o slow" were misunderstood by about half of the sample, 
therefore these items were dropped from the analysis, 
•fhe second side of the Student Weekly g.esponse Form 
^^asufed students' comprehension of story line, knowledge 
^^•^ niath c^^^^^^^V "^^^it^d^s ^fecQjai^ amKs^cial atti- 

^Udes. T^n statements which sainpled"EKs*^bjectives of 
^^he progr^'^ above areas were used each week. The 

'^'^sitor and students read through the ten statements 
^^S^ther. ^ student agreed with a statement,, he^ or 

^He circled yes; if a student disagreed with a state- 
^^tlt he o'r she circled no. 

Pj-eliffliriary examination of the data revealed a 
^^sitive response bias in students' responses to these 
' tems Tti^. ^^^P^ score on positively worded items~was 
^^nsistent^ly higher than uae^ mean score on negatively 
^^rded it^'^s* Comparison of mean scores on positive items 
^^th mean scores on negative items revealed that this 

wa6 operating equally across all groups. In brdet 
Control this bias, items were not analyzed separateily 
Were aggregated into subscales with equal numbers ^f 
^^sitiveiy and negatively iwordedi items. / 

In addition, two free response items were included 
appropriate. Students were able to complete the. 
^^udent Weekly Response Form in approximately 15 minutes. 

*' ' * 

[gf iident Attention Form . Visitors were trained to 
^^serve an^ record viewing behavior o^ students while they . 
^^tched th^^^l^vis^^^ program, using the Student Attention 
^^^rm (see Appendix C) . The visitor observed two groups 
five st:^^^^^s each, alternating between groups every 15 

• ' ■ ' . " . 16 , 
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Seconds. The visitor recorded the number of students in 
each group who were either attending to or actively 
responding to the program during that 15-second interval. 
Attending: was operationally defined as maintaining eye 
Contact with the television screen; responding was defined 
as being actively, involved with the program, e.g., com- 
menting on the program, laughing, or moving to the music. 
Audio cues on the- Student ^^ttention Form indicated the 
^nd of each 15- second segment. 

Jeacher Weekly Questionnaire . Each week the teacher 
Completed a Teacher Weekly Questionnaire (see Appendix C) • 
This instrument was the same for each week and contained 
39 statements which teachers checked if they agreed with 
the statement. ; Statemients dealt with' ll areas related to 
the program:, 

1. educational effectiveness; 

2. class preparation; 

3. .program guides; ^ . 
'4. program presentation; 

5. use of language; 

6. technical quality; 

7. student attention; 

8. program appeal; 

9. math content; 

10. math attitudes ; and ; ^ 

11. social attitudes. 

tn addition, teachers were encouraged to write<^any comments 
they might have on specific aspects of the program and/or 
changes they would suggest. Tea.chers were also asked to 
report any follow-up activities which took place during • 
the week, and to describe any students' reactions to 
Previous weeks' programs. 

^ -.17 



Visitors attended a one-aay training session where 
the objectives of the evaluation study, procedures to be 
followed, and instruments to be used were explained. 
Detailed, written instructions for using each instrument 
were provided, including protocols for instructing 
students in the use of the Student Weekly Response Forms 
and for any additional verbal information to be provided 

students. Videotapes of groups of children jc^tcjiing_a_ 

television program were used to train visitors in the 
use of the Student Attention Form^ and to maximize inter- 
rater reliability among visitors. \ 

Teachers attended a half-day orientation session 
where the objectives and scope of the "Infinity Factory" 
series and the procedures of the evaluation study were 
explained," Teachers were provided copies of Program 
Guides for the eight programs (see Appendix M) , and were 
told to use the programs as they saw fit with their students 

Testers were provided with specific instructions 
on procedures to be followed during the pre- and post- 
testing sessions. 

Experimental Procedures 

The programs were broadcast over WGBH-TV for Boston 
and Lawrence classes, and over KCET-TV for Los Angeles 
classes. Classes in New York viewed the program using 
inr school videotape equipments 

Pretest Session , The first week pf the evaluation, 
testers arrived at the classroom^^t specified times which 
were convenient for the class. The tester gave the 
teachers the Teacher Semantic Differential to be filled 
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out while the students completed the Student Attitude Form 
and then the Student Math Content Form, Each instrument 
took approximately 15 minutes. — When the LesLe r dist r ibuted 
the Student Attitude Form, he or she asked students to put 
their first name and last initial at the top of the pag^. 
Then, the students were asked to give their true feelings 
in a number of different areas, and told that there were 
no right or wrong answers to the statements to be read. 
Students were assured that their teachers , principals , 
and parents would not see their responses. When the 
Student Math Content Form was distributed to students, 
they were instructed to leave a statement unanswered if 
they did not know the answer. . 

Experimental Sessions . For each of the eight weekly 
viewing sessions, the classroom visitor arrived in the 

classroom about 15 minutes before the program was scheduled 

<'....'• 

to begin. The visitor recorded any related classroom 
activities which occurred before the program. 

The class viewed the half-hour television program 
either in theiTr classroom or in another room in the school. 
During the viewing session, the visitor recorded eye con- 
tact and active responses for two groups of five students 
eacK, alternating from one ^roup to another at 15- second, 
intervals, using the Student Attention Form. 

Immediately following program viewing, the visitor 
and students completed the Student "Weekly Response Form. 
The visitor and students read through all items together 
as the students f illed ,qut this form. At the same time, 
the teacher completed a Teacher Weekly Questionnaire. 

Afterwards, the visitor observed and recorded any 
follow-up classroom activities. Before leaving the class- 
room, the visitor reminded the teacher to take note of 
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any related activities during the coining week, and to take 
note of any incidental references to the program made by 
the. students. '■ ~~ ~ '. 

Visitors monitpred what happened in the classroom 
before, during, and after program viewing. They reported 
and^ate^orized any related activities which occurred 
before or after the program, noting whethefer the teacher 
dealt with the math content, cultural, or- other attitu- 
dinal areas of the program and whether the teacher used 
any suggestions— from the: Program- Guides.- - - - . - 

Post test Session . During the. week following, 
broadcast of the eighth program, the tester who had 
administereA the pretest returned to 'the same' classroom 
and repeated the pretest procedures for the Student 
AttLtude Form, Student Math Content Form, and Teacher 
Semantic Diifereritial. At , this time the tieacher also 
completed the Teacher Opinion Form. 

Limitations of the Study 

.... ' ' . ^^.^ 

Several factors have been identified which limit the 

generalizability of thi§, study: 

1. Technical problems arose in all cities. In 

some cases, statiorfs broadcast programs at the 

wrong time or In incorrect sequence. Problems 

with both hardware and software came up in 

classes which used portable videotape equipment 

to view ihe program. ' 

. 2. The sample for the study was selected by school 

administrators oh very short notice. It is 

unlikely that the sample selection procedure yas 

exactly randoiny but there is reasonable con- . 

■ , • . ' 20 ■ ■ ■ 
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fidence that the sample is sufficiently repre- 
sentative of the population. 

Background data were collected only on students* 
age, sex, and ethnic group. 

The forced choice format used for student instru- 
ments has the advantages of being easy for 
students to understand and controlling for ' 
reading ability. However, such a format gives 
less detailed information than free-response 
formats about attitudes and understanding of 
path content . 

Although instrtmients and procedures were designed 
so that immediate and individual responses of 
students could be obtained, visitors reported 
that in some classroom settings minor ' problems 
were encountered with interference from peers or 
teachers . 

It was recognized that a potential difficulty in 

measuring appeal is the tendency for students to .. 

report what they think* adults would like to hear. 

To compensate for, a detected positive response 

bias, sTudents* responses were aggregated into 

♦ ■ 

subscales with equal numbers of positive and 
negative items . ^ 
Test iteJis had content and face validity. Time 
constraints did not allow for extensive, rigorous 
test construction procedures (e.g. , itism analysis), 
resulting in minor problems with some test items 
which were later accounted for in the data analysis 
In a 10-week study, problems were expected with 
mortality. Out of a total sample of over 1,000 
students, the mean nuffiber viewing each^week was 

0 



800. The sample for pretest/posttest analysis 
-xxansis4:ed-of-the— — 
test/posttest measures and saw at least six of 
the eight programs- The sample for analysis of 
comprehension*, math content, and attitude sub- 
scales consisted of the 383 students who saw all 
eight programs. The sample for analysis of atten- 
tion trends consisted of 21 classes for which 
data from all eight programs were available , and 
the sample for trend analysis^ of teacher responses 
consisted of 27 teachers who completed Teacher 
Weekly Questionnaries for all eight programs . 
In some cities, the progra.m was available for 
home viewing dliring sqme weeks. Althoughv students 
were not informed o-f this, a number reported 
that they had Watched some programs at home. 



3. ANALYSIS OF THE DATA 



Dat.a were analyzed using computer programs from 
the Statistical Package for the Social Sciences (SPSS). 
Programs from these packages provided frequency data, 
statistical analyses, and, in some cases, posthoc analyses. 
The value of £ < .05 vj^s selected as a minimum level of 
statis*tical significance. / 

f- ft 5 

Student Attention " 

^ a An. attention score was calculated from the mean 
percentage of children attending to and/or actively re- 
sponding to each 15-second seginent. From this score the 
mean percentage of attention was calculated for each show, 
overall' and for each major segment. - 
Mean percentages of . attention for the eight shows 
were comparied losing a fixed effects, 21 (classes) X 8 / 
(shows), repeated measures analysis -of variance. The 
two-way model was used in order to examine ':<lifferences 
in overall attention among shows for the entire sample, 
after any differences which could be attributed . to diffferenc 

among classes was removed. Differences among classes were 
expected; they were considered to be the result of both 
actual difference among groups and differences in the way 
visitors recorded attention, and were reported but ^ 

not discussed. ; 

The sample for this analysis ^ consisted of the 21 
classes for which attention data were available .for all 
eight shows i Posthoc contrasts usitjg the Scheffe test 
were performed to compare attention among the eight shows^^ 
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Student Appeal 

Student appeal^^ was determined from responses to the 
first. side of the Student Weekly Response Forms (see Appen- 
dix C) . Students rafed five areas of each sho (th# 
show overall, /"Browns tone" segments, "City Flats," "Scoops' 
Place," and animation segments) as being hard or easy, good 
or no good, and ftm or no fun. Responses on the adjective 
pairs were aggregated into subsc.ales; 

1. Weekly Subscales for the five areas of each , 

D 

show, based on the number of positive adjectives 
checked for each particular week (the 40 Weekly 
Subscales range from O.to 3); 

2. Total Weekly Subscales, based on the total 
number of positive adjectives checked for all 
five areas for a particular week (the eight Total 
Weekly Subscales ifanged from 0 to 15); 

3. Total Series Subscales for the five areas, 
based on the total number of positive adjectives 
checkecT^for-^the total of eight weeks (the five 
Total Series" Sub^^ales ranged from 0 to 24). 

Comparisons of shows -were nia:de by analyzing the 
Weekly Subscales and the Total Weekly Subscale mean scores 
using one-way analyses of variance. A test for linear 
trend was made where appropriate i 

domparisons of groups were made by analyzing the 
five Total Serie^^ Subscales using a 3 (e'thnic group) X 2 ^ 
(age) X 2 (sexx analysis of .variance. 

Where significant F ratios were found, postlioc x 
comparisons were performed using the Scheff^ test. 

Comprehension of Dramatic Story -Line 

Students' comprehension of the story line was i 
assessed by analysis of a Comprehension Subscale constructed 
from students' responses to comprehension items on the 



* Student Weekly Response Forms;* . In order to control for, posi- 
tive response bias, 12 positively worded and 12 negatively 
worded items were randomly selected for^ the Comprehension . 
Subscale (see , Appendix D) . • ^ - • 

- Comprehension subscale scores were analyzed. uaxng a 
fix^d effects, 3 Cethnic groups) X 2 (age) X 2 (sex) - 
analysis of variance. VJIiere there were significant ethnic 
group effects, posthoc contrasts were, performed using the ^ 
.Scheff^ test on mean subscale scores. 

Knowledge' of Hath Content ^ ' ' ^ ■ • 

Effectiveness of- the* eight-show treatment in- improv- 
ing students' knowledge of -math content ^as assessed in 

• two ways : ^ 

1. by comparison of the pretest and posttest results 
on the Student Math Content Form; and ' 

2. by an analysis of a faath content subscale con- 
structed from the students' responses on the eight 
St:udent Weekly Response Forms. . . 

The sample for the pretest/posttest analysis consisted 
of all students 'who had completed both' the pretest and -the post- 
test, and who ^ had seen at least six of the eight shows. The 
entry levels of the various groups in the sample were determined 
by analyzing mean pretest scores using a fixed effects, 3 (eth- 
nic group) X 2 (age) X 2 (sex) analysis of variance. 

Pretest and posttest scores on the Math Content Form were 
compared by perfarpiing. a :t-test on the overall^ean gain score 
(posttest score 7 pretest ^core) . 

Then a^ analysis of gain scores was performed, 
6ontrolling for students' performances on the Math 
Content Form pretest. Content gain scores were ^ 

*Iteins from the Student Weekly Response Form,- Show C, were dropj>ed from the 

analysis of Comprehension, Math Content, and Attitude Subscales because 
• 31% 04^ the classes had reported audio or video problems for that show. 



analyzed using a 3 (ethnic group) X 2 (age) X 2 (sex) 
analysis of-covariance, with pretest scores as the covariate'. 
Any variation in gain scores attributable to pretest score 
differences was removed before analyzing the effects of ethnic 
group, aae. sex. and interaction terms. >. ^ 

Wh'ere there were . significant ethnic group effects, 
posthqc contrasts were performed using ttle Scheffe test. . 
For the analysis of covariance, this 'analysis was performed^ 
on the adjusted means. ' • ' 

- The Math Content Subscale was constructed from items 
on matlvr content on the .eight Student Weekly Response Forms. 
In order ^ to control for positive response bias, tout posi- 
tively worde^ items, four nergatively worded items, and four 
frefe response" item's were randomly selected for this -^z 
subscale (see Appendix D) . / ^ ■ 

Analysis of the Math Content Sutscale was carried 
but in the ^ame'way as the analysis of- th^ Comprehension /* \ 
Subscale reported in the previous section. 

Student Attittldes 

Effectiveness of the . etghli- show treatment in 
influencing students' attitudes was assessed in two ways:' 

1. -by comparison o£ the pretest and posttest ' • 

tes'ults on tlie- Sttident Attitude Form; aftd 

2. by an analysis of an-Attitude- Stibscale 
constructed from students' responses on t;;be 
eight Student .We.ekly Response Forms. ^ 

' Analysis of pretest/posttest differendes on the 
Studeitt' Attitude Form' was carried out in the saine way 
as the analysis of the. Student Math Content Form, described 
in the previous section. 

The Attitude Subscale, was constructed from items .on 
social attitudes and attitudes toward math on the- eight 
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Student Weekly Response Forms. In order to control for 
positive response bias, nine positively and nine negatively 
worded items were randomly selected for this subscale 
(see Appendix D) . 

Arialys-is of student responses on the 18-item 
Attitude Subscale was carried out in the same way as the 
analysis of student responses on the Comprehension sub - 
scale described above. ^ 

Teacher Responses 

Differences in teachers' attitudes toward educa- 
tional television, math, and television programs on math 
were assessed by comparison of pretest and posttest dif- 
ferences on the Teacher Semantic Differential. Each of 
the three concepts was rated for 20 pairs of bipolar ad- 
jectives on a scale of one (least positive) to seven 
(most positive); The mean score for all teachers for the 
20 adjective pairs was computed for each concept. A two- 
, tailed, correlated t-test ,was used to compare differences 
on the pretest and posttest scores. 

Teachers* attitudes toward the. eight "Infinity 
Factory" programs were assessed by a comparison of 
teachers' respons^es^J:^^^ the 39 items on the Teacher 
Weekly (Questionnaire (see Appendix C)o Ten subscales 
were constructed from 37 itemst ' • 

^ 1. Glass Preparation; 

2. Program Guides; 

3. iProgram Presentation; ' 

* . • » 'J , . " ' 

4. ^Language; Use of Language; 

» 5. Technical Quality; ^ . 

.6. .Student Attention; . 
7. Student Appeal; 

'8.. ,Math Content; . ^ . 



9. Math Attitudes; 

10. Social Attitudes. 

The items which made up each subscale are listed 

in Appendijf Eo . • . 

Item 37 ("This program is educationally ' eiffective") , 

and Item 38 ("The overall presentation in this week's 
program was outstanding (=4) , good (=3) , mediocre (=2) , 
or poor (=1)") were analyzed separately. 

Teacher subscales and items 37 and 38 were compared 
using a fixed effects, 8 (show) X 27 (teacher), repeated.- 
measures analysis of variance, with a test for linear 
trends over shows. The two-way model was used in order to 
examine differences among shows after any differences which 
could be attributed to teachers were removed. Differences 
among\eachers we7--e expected and were reported but not Ms- 
cussed. The sample for this analysis included all teachers 
"vho had- completed Teacher Weekly Questionnaires for all 
eight shows. Where significant F ratios were found for the 
main effect of show, posthoc contrasts were performed using 

the Scheff^ test. 

Tearf:hers' responses to the four questions on the 
Teacher Opljiion Form were categorized, tabulated, and 
nalyzed informally. 
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4 . RESULTS 



Student Attention 

Mean percentages of student attention over eight 
shows for the 21 classes for which complete attention data 
were available are . shown in Appendix F, Table F,l, 

Two-way analysis of variance (see Tabte 4,i) revealed 
significant differences in mean attention amo.ng classes 
(£ < .001) and a significant difference over eight shqws 
(£ < .05). There was no significant linear trend over 
eight shows at the .05 level (see Figure 1) . 

Although the main effect of difference among shows 
is significant, Scheff^pbsthoc analyses revdaled that when 
mean percentages of attention are compared, no differience 
between any two shows is significant at the .05 level. 



Table 4.1 

Student Attention Trends: Analysis of Variance 



Source of Variation 


SS 


df 


MS 


F 


Main Effects 


17.76 " .„ 


27 


.65 


4.32*** 


Class 


15;02 


20 


.75 


4.93*** 


Show 


2.74 


7 


.39 


2.57* 


Linear Term 


.37 


. 1 


.37 


2.46 


Deviation from Linear 


2.37 


6 


.39 


2.60 


Explained " 


17.76 


27 


.65 


4.32*** 


Error 


21.30 


140 


.15 




Total 


39.07 


167 


.23 





*£ < -OS. 
***P < .001. 
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Student Appeal 

Comparisons of Shows . Reported "telow are five one- 
way analyses of variance t)erforTned on the Weekly Appeal 
Subscales for the show overall, ''Browns tone" segments, 
"City Flats," "Scoops' Place, and animation segments. 
Also reported are the results of tests for linear trend 
over shows and Scheffe posthoc analyses on the five Weekly 
Subscales. Descriptive statistics and results of five 
one-way analyses of variance are shown in Appendix G, 
Tables G.l to G.IO. These results are siifnmarized in Table 
4.2 below, which presents F^ratios, degrees of freedom, and 
levels of significance for show effect and linear trend 
over shows . g Q j > 



Table 4.2 

Comparisons of Student Appeal Among Shows: 
Summary of Results 



Weekly Appeal Subscale 






Show 




Linear 


Trend 






df 


F 


df 




F 


Show Overall 


(7, 


6474) 


21.10*** 


(1, 


6) 


44.63*** 


Browns tone 


(7, 


6369) 


16.68*** 


(1, 


6) 


97.62*** 


City Flats 


(7, 


6398) 


. 3.31** 


(1, 


6) 


4.51* 


Scoops' Place 


(7, 


6362) 


15.20*** 


(1, 


6) 


5.08* 


Animation 


(6, 


5519) 


6.23*** 


a. 


5) 


15.20*** 



*£ < .05 

**£ < .01 
***£ < .001. 



The five one-way analyses of variance revealed sig- 
nificant differences among. shows and significant linear 
trends on all five Weekly Appeal Subscales. Scheffe postr 
hoc analyses revealed that when Weekly Appeal Subscale 
scores are^ compared between shows pairwise, the following 
differences are significant (£ <o05): 

1. Mean Weekly Appeal Subscale scores for the show 
overall for Shows A (2.84) and B (2.80) were 

^ significantly higher than for the other shows, 
and mean show overall Weekly Subscale scores 
for Shows G (2.55) and H (2.59) were signifi- 
cantly lower than for the other shows; 

2. Mean "Brownstone" Weekly Appeal Subscale scores 
were significanly higher for Shows A (2.75)> and 



(2.71) than for the other shows, and signi- 
ficantly lower for Shows G (2.46) and H (2.49) 
than for the other shows; 

3. Mean "City Flats'^ Weekly Appeal Subscale 
score for Show A (2.70) was significantly 
higher than Show G (2.58); 

4. Mean "Scoops' Place" Weekly Appeal Sub- 
scale score was significantly higher for Show 
C (2.71) than Show A (2.37); 

5. Mean animation Weekly Subs^cale score was 

J significantly lower for Show G (2.60) than for 

Show p (2.72), Show B (2.74), and Show F (2.77); 
and significantly lower for Show H (2.63) than 
Show F. . 

The Total Weekly Appeal Subscale was computed from 
the sum of the five Weekly Appeal Subscales analyzed above. 
Descriptive statistics and results of one-way analysis of' 
variance, including, test for linear trend over shows, per- 
formed on the Total Weekly Appeal Subscale, are shown in 
Appendix G, Tables G.ll and G.12. 

Onerway analysis of variance on the Total Weekly 
Subscale revealed a significant difference among shows, • 
F(7, 5794) = 6.69, £ < .001. There was a significant 
downward linear trend over shows, F(i, 6) = 18.35, £ < 
.001. Scheffe posthocanalyses revealed that when Total 
Weekly Subscale scores are compared pairwise. Show G 
(mean = 12.93) is rated significantly lowe,r than. Shows 
C, D, F, or B (means = 13.46, 13o50, 13.58, and 13.67, 
respectJ^vely) ; Show A (mean = 13.35) is rated significantly 
lower than Show.B. 

Comparisons of Groups . Reported below are the 
results of five three-way analyses of variance ( 3(ethniCo 
group) X 2 (age) X 2 (sex)) performed on the Total Series 



Appeal Subscales for the show overall, "Browns tone" seg- 
ments, "City Flats," "Scoops' Place," and animation seg- 
ments. Descriptive statistics and results of the five 
three-way analyses of variance are shown in Appendix H, 
Tables^ H.l to H,10, * 

Three-way analysis of variance on Total Series Appeal 
Subscale scores for the shows overall revealed a significant 
difference among mean scores for Black (21.92), Latino 
(21.53), and non-target (20, 34) students , F(2, 273) = 4,72, 
£ < .01. Scheffe posthoc analyses revealed significant 
differences between Black and non- target students' Total-" 
Series Subscale scores, and between Latino and non-target 
students' scores. However, the difference between Black 
and Latino students was not significant at the .05 level. 

There was no significant difference between younger 
and older students* scores on Total Series Subscale for 
the shows overall (means = 21,60 and 20,97, respectively), 
F(l, 273) * 12,21, £ < ,05, However, the Total Series 
Subscale score was significantly higher for girls (mean = 
21,96) than for boys (mean * 20,56), F(l, 273) = 126,91, 
£ < ,001, ^ 

There was a significant interaction between ethnic 
group and sex, F(2, 273) = 74,98, £ < ,001. The Total 
Series Subscale scores for the shows overall were higher 
for Latino (mean = 22,00) and non- target (mean = 2i,96) 
girls than for Latino (mean = 20,86) and non- target 
(mean = 18,78) boys. However, mean Total Series Subscale 
scores were slightly lower for Black girls (21,89) than 
for Black boys (21,99), There were no other significant 
two-way interactions on the Total Series Subscale for the 
shows overall. 

Three-way analysis of variance on "Brownstone" Total 
Series Appeal Subscale scores revealed significant differences 



among mean scores for Black (21.89), Latino (21. 33), " and 
non-target (19.60) students, f(2, 252) = 95.78, £ < .001. 
Schefffi posthoc analyses revealed a significant difference 
between Black and non-target students' scores (£ < .05). 
There were no significant- differences between Total Series 
Subscale scores for Black and Latino students or between 
Latino and non- target students." 

There was no significant ' difference between 
younger and older students' scores (means = 21.49 and 
20.40, respectively) on the "Brownstpne" Total Series 
Subscale, F(l, 252) = 2.96, £ > .05. Mean subscale Scores 
were significantly higher for girls (21.88) than boys (19.99), 
F(l, 252) =, 16.83i £ <^ .001. 

There was a significant interaction between ethnic ^ 
group and sex, F(2, 252) = 6.20, £ < .01. Total Series 
Subscale scores were higher for Latino and non-target 
girls (mearis"^= 22.28 and 21.44, respectively) than for 
Latino and non- target boys (means = 20.27 and 17.60, 
respectively) . However, Total Series Subscale scores were 
slightly lower for Black girls (mean = 21.76) thanT:^o::?: 
Black bdys (mean = 21 . 90) . 

Three-way analyses of variance on "City Flats" 
Total Series Subscale scores revealed significant difr 
ferences among ethnic groups, F(2, 248) = 3.44, £ < .01. . 
Scheffe posthoc analyses revealed that the mean Total 
Series Subscale scores were significantly lower for non- 
target stu<ierits (20.34) than for Black (21.52) and . 
Latino (21.52) students, F(l, 183) = 6.18, £ < .:05. 

There Was no significant difference between "City 
Flats" Total Series Subscale scores for younger and older 
students (means = 21.52 and 21.79, respectively), F(l», 248) 
*" .14* £ '05, Mean subscale scores were significantly 
higher'for girls (21.54) than for boys (20.71), F(l, 248) = 
3.95, £ < .05. 1 
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There was a significant interaction between ethnic 
group and age, F(2, 248) « 4,08, £ < •05, Older Black 
and Latino students (means « 22.12 and 21.59, respectively) 
rated "City Flats-' higher than yomger Black and Latino 
students (means "^1.20 and 21.38) respectively). However, 
younger non- target students (mean ■» 21.26) rated "City 
Flats" higher than older non-target students (mean « 19.54). 

There was also a significant interaction between 
ethnic group and sex F(2. 248) - 2.20, £ < ,05. "(City 
Plats'^ Total Series Subffcale scor.es were "higher for Latino 
and non-t^get girls (means « 21.92 and 21.24, respectively) 
than for Latino and non- target boys (means « 20.94 and 19.42, 
respectively). ^ However, Total Series Subscale scores were 
slightly lower fdr Black girls (mean = 21.44). than for Black 
boys (mean = 21.56). 

There was no significant interaction between age 
and sex on the "City Flats" Total Series Subscale score. 

Three-way analysis of variance on "Scoops* Place" 
Total Series Subscale scores revealed significant dlfference3 
among ethnic groups, F(2, 238) = 6.82, £ < .001. Scheffe 
posthoc analyses revealed that Total Series Subscale 
scores for Black and Latino students (means « 21,41 and 
21.06, respectively) were not significantly different, 
but that scores for both groups were significantly higher 
than for non-target students (mean =» 19.52). 

There was no significant difference between "Scoops' 
Place" Total Series Subscale scores for younger and older 
students (means =20.77 and 20.70, respectively) , F(l, 238) 
" ^08, £ > .05. There was no significant difference 
between "Scoops' Place" subscale scores for boys and girls 
(means = 20.28 and 21.13, respectively), F(l, 238) = 3.32, 

E > •P5. ^ 

There were no significartt two-way interactions 
on "Scoop^s* Place*! Total Series Subscale scores. 
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The Total Series Subscale for animation segments . 
was calculated from the sum of weekly appeal subscales 
for Show B to Show (Responses for Show A were dropped 

from analysis because there was no cartoon animation in 
Show A.) The score on the 21 items from Shows B through 
H was then multiplied by 8/7 to dchieve a score with a 
maximum of 24 in order to facilitate comparisons with 
other Total Series Subscales. 

The grand' mean for the animation Total Series 
Subscale was 21.65. There were nip significant differences 
among ethnic groups • F(2, 270) = 1.55, £ > .05; ages, 
F(l, 270) « .92, £ > .05; and sexes, F(l, 270) = 1.77, 
£ > .05. There were no significant two-way interactions 
among variables. 

Comprehension of Dramatic Story Line 

Frequency data for the Comprehension Subscale are 
shown in Appendix I, Tables I.l. The grand mean for all 
subgroups was 77.7. 

Three-way analysis ^of variance (see Table 4.3) 
revealed no significant differences (£ > .05) among Cora- 
prehension Subscale scores for Black (76.6), Latino (78.4), 
and non-t^get (78.7) students. Mean Comprehension Sub- 
scale scores were significantly higher (£ < .01) for older 
(80.08) than^f^r younger (75.99) students. There was no 
significant difference (£ > .05) between mean Comprehension 
Subscale scores for girls (78.24) and-boys (77.1). 

There were no\significant two-way interactions on 
Comprehension SubscaleX^scores. 

*Coinprehension, Math Content, and Attitude Subscale scores were conver- 
ted to a 100-point scale to facilitate comparisons among subscales. 



Table 4.3 

Analysis of Variance: Comprehension Subscale 
/Source of Variation SS ii M Z 



Main Effects 


1616.14 


4 


404.03 


3.08* 


Ethnic Group 


113-38 


2 


56.69 


0.43 


Age 


1192.89 


1 


1192.89 


9.09** 


Sex 


89.91 


1 


89.91 


0.68 


Two-Way'^ In terac t ions 


852.45 


5 


170.49 


1.30' 


Ethnic Group X Age 


199.64 


2 


99.82 


0.76 


"Ethnic Group X Sex 


606.99 


2 


303.49 


2.31 


Age X Sex 


21.56 


1 


21.56. 


0.16' 


Explained 


2468.60 


9 


274.28 


2.09* 


Error 


43924.91 


335 


131.11 




Total 


46393.52 


344 


134.86 





Note . II B 345 » all students for whoni complete data were available. 
*£ < .05 . ^ 

**£ < .01 

% ■ . ' 

Knowledge of Math Content 

Pretest/Posttest Comparisons ,, Descriptive statistics 
for math content pretest and gain scores are shown in Appen- 
dix J, Tables J.l and J,2* 

Three-way analysis of variance on math content pretest 
scores (see Table 4,4 below) revealed no significant differences 
(£ > •05) among pretest scores for Black, Latino, and non- 
.targst students (means = 9,41. 9,13. and 9 • 38, respectively) • 
Pretest scores were significantly greater (£ < .001) for 
older (mean =» 9.92) than younger (mean = 8.70) students; and 
significantly greater (£ < .OOl) for boys (mean = 9.71) than 
girls (meaA»9.02). 

<■. • •! • ■ ^ ' 37 ■ 
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Table 4.4 



Analysis 


of Variance: 


Math Content 


Pretest 




Source of Variation 


SS 


df 


MS 


F 


Main Effects 


, 340.56 


• 4 


85.14 


11.46*** 


Ethnic Group 


31.16 


2 


15. 58 


2.09 


Age 


253.85 


1 


253.85 


34.18*** 


Sex 

•1 


83.34 


1 


83.34 


11.22*** 


Two-Way Interactions 


68.87 


5 


13.77 


1.85 


Ethnic Group X Age 


16.21 


2 


8.10 


1.09 


Ethnic Group X Sex 


^ 50.04 


2 


25.02 


3.36* 


Age X Sex 


5.49 


1 


5.49 


0.74 


Explained 


409.44 


9 


45.49 


6.12*** 


Error 


4827.52 


650 


7.42 




Total 


5236.96 


659 


7.94 





Note, n = 660 = all students who completed pretest and posttest 

and saw aft least six of the eight shows. 
*P < .05 , ) 

< .001 .! 



There was a si^ificant interaction (£ < .05) be- 
tween ethnic group and sex. While pretest scores were 
higher for boys than girls for all ethnic groups, the 
difference between non- target boys and girls was con- 
siderably greater than between Black and Latino boys and 
girls. Figure 4.2 illustrates this interaction. No, 
other' two-way interactions were significant at the ,05 
level, 

' . 38 
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P NON-TARGET BOYS ( 1 0.1 4) 
BLACK BOYS (9.63) 

BLACK GIRLS (9.26) ^ ' r^K'^' ' '^ LATINO BOYS (9.41) 

LATINO GIRLS (8.94) 

. . - ^ 



NON-TARGET GIRLS (8.68) 



MATH CONTENT MEAN PRETEST SCORES: 
INTERACTION OF ETHNIC GROUP AND SEX 

' Figure 4.2 



9 

The overall mean gain score (3.07) was significant, 
at the £ < .001 level, t (659) « 26.10. 

Three-way analysis of covariance (see Table 4.5 below) 
revealed a significant difference (£ < .001) among adjusted 
gain scores for Black (2,73), Latino (2,98), and non- target 
(3.75) students. Scheffe posthoc analyses revealed that 
the differences between, adjusted mean gain scores for Black 
and Latino students was not significant, and that non-target 
r students' adjusted mean gain scores were significantly 
'greater- (£< .05) than Black and Latino students' adjusted 
mean gain scores. 

Adjusted mean gain scores were significantly higher 

(£ < .001) for older (3.50) than for yomger (2.68) students. 
The difference between adjusted mean gain scores for boys 
(3.25) and girls (2.94) was not -significant (£ > <i.05). 



Table 4« 

Analysis of Covarlance: Math 


5 

Content 


Gain Scores 




Source of Variation 


SS 


df 


MS 


I 


Coyariate ^ • , 
Content Pretest Score 


1896; 08 


1 


1896.08 


331.69*** 


Main Effects 
Ethnic Group 
Age 
Sex 


250.49 
108.82 
101.93 
- 15.32 . 


4 
2 

1 
1 


62.62 
54. 4J 
101.93 
15.32 


10.95 

9.51*** 
17.83*** 

2.68 


Two-Way Interactions 
Ethnic Group X Age 
Ethnic Group X Sex 
Age X Sex 


. 170.41 
4.97 
158.32 
17.93 ^ 


2 
2 
1 


34.08 
2.48 
79.16 
17.93 


5.96*** 
0.43 

13.84*** 
3. 13 


Explained 


2316.99 


10 


231.69 


40.53*** 


Error 


1709.87 


649 


5 . 71 




Total 


6026.87 


659 


9,14 





***£ < .001 



There was Ja-si^^ between 
ethnic group and sex (£ < .001). Gain scores were higher 
for Black and non- target girls (means = 2.78 and 4.54, respec- 
tively) than for bpys (means = 2.30 and 2.90, respectively). 
However, mean gain sdores were higher for Latino boys (4.01) 
than girls (2.58). There were no other significant two-way 
^jinteractions. ^ . *^ . 

Math Content Subscale . Descriptive statistics for 
the Math Content Subscale are shown in Appendix J, Table J. 3.. 

Three-way analysis of variance Csee Table 4.6) 
revealed a significant' dxffierence (£ < .001)' among mean sub- 
scale scores for Black," Latino, and non-target students 
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(means = 71.2, 71.8, and 80^X, respectively), Scheffe 
posthoc analyses revealed that the difference between Math 
Content Subscale scores for Black and Latino students was 
not significant (£ > .05); however, differences between 
Black and non-\target students, and between Latino and non- 
target students were significant < o05>o 



Table 4.6 

Analysis. of Variance: Math Content Subscale 



Source of Variation 


SS 


df 


MS 


. F 


Main Effect:s 
Ethnic Group 
Age 
Sex 


15112.00 
4043.65 
9186.46 
23.27 


4 
2 
1 
1 


3778.00 ' 
2021.82. 
9186.46 
23.27 


16.49*** 
8.82*** 
40.11*** 

o.io:r 


Two-Way Interactions 
i- Ethnic .Group X Age ■ 
Ethnic Group X Sex 
Age X Sex 


275.93 
186.85 
95.84 
0.82' 


5 

;/ 


55.18 
93.43 
47.92 
0.82. 


0.24 
' 0.40 
0.20 

o.go •. 


Explained 


15387.93 


; 


1709.77 


7.46*** 


Error 


85415.81 


373 


228.99 




Total 


100803.75 


/ 382 


263.88 





Note, ri " 383 = all students for whom^complete data were available. 

***£ < .001 y 

■ / . ' 

i ■ ' 

/ 

M^th Content Subscale scores were significantly 
higher (£ < .001) for older /(mean = 79.8) than yoxinger 
(mean = 69#0) students. There was no significant dif- 
ference (2. > .05) between boys ' and girls ' subscale 
scores (means = 73.5 and 74. 1 , respectively) . There were 
no significant two-way interactions (£ > .05). 
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Student Attitudes 

Pretest/Posttest Comparisons^ Descriptive statistics 
for pretest and gain scores on four areas of student atti- 
tudes (social and math attitudes related tp series goals , 
attitudes toward television, attitudes toward math, and 
attitudes-v_toward television programs on matH) are shown in 
Appendix K, Tables K/i to K,8. 

The overall mean gain score (.63) on the 14-.item measure 
of social and math attitudes related to program goals was sig- 
nificant at the £ < .001 level^, t ($59) = 8.12. Three-way 
analysis of covariance on mean gain scores (see Table 4.7 below) 
revealed significant differences (£ < .05) among adjusted 
mean gain scores for Black (-83), Latino (.57), and non- 
target (.38), students. Scheffe posthoc analyses revealed 
that the difference between adjusted mean gain scores for 

■y 

Black and non-target students was significant (£. < .05). 
However, differences between adjusted mean gain scores for 
Black and Latino students, and for Latino and non-target 
students were not significant at the • 05 level. 

Adjusted mean. gain scores for social and math attitudes 
were significantly higher for girls (1,01) than boys (,12), 
There were no significant differences between older and yoionger 
students' gain scores (adjusted means = ,50 and -75, respec- 
tively) • There were no significant two-way interactions on 
social and math attitudes gain scores. 

\ 
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. Analysis of Covariance: 


* Table 4.7 
Gain Scores, 


Social and Math Attitudes 


Source of Variation 


SS 


df MS Z 



Covariate 



irxeucSu score 


JO J • yo 


1 


553.96 


194.26 


Main Effects 


146.37 ■ 


4 


36.59 


12.60*** 


Ethnic Group 


22.60 


2 


11.30 


3.89* 


Age 


10.38 


1 


10.38 


3.58 


Sex 


102.59 


1-' 


102.59 


35.34*** 


Two-Way Interactions 


S 9 . 02 


5 


3.80 


1.31 


Ethnic Group X Age 


8.00 


2 ■ 


4.00 


1.38 


Ethnic Group X Sex 


2.75 


2 


1.37 


0.47 


Age X Sex J 


8.04 


1 


8.04 


2.77 


Explained 


729.35 


V. 10 


72.94 


18.40*** 


Error 


1882.63 


649 


2.90 




Total 


2611.98 


659 


3.96 




*p < . 05 










**p < .01 










**^p < .001 
















\ 







There was no significant difference between overall mean 
pretest and posttest scores on attitudes toward television, 

t(606) = -50, £ > .05. In addition, three-way analysis of cova- 
riance on these mean gain scores (see Table 4.8 below) revealed 
no significant differences among ethnic groups, age groups, ' 
and sexes; and no significant two-way interactions between 
these main effects (£ > .05 for all main effects and interr 
actions); 
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Table A. 8 



Analysis of Covariance: Gain Scores, Attitudes Toward Television 



Source of Variation .. 


SS 


df ' 


MS 




-■ 

Covariate 

Pretest Score 


157.62 


1 


157,62 


• 

297.82*** 


Main Effects 
Ethnic Group 
Age 
Sex 


2.01 
r 0.76 
0.10 
1.10 


4 
2 
1 

,1 


0.50 
0.38 
0.10 
1.10 


0.94 
0.71 
0.18 
2.07 


Two-Way Interai^tions. 
Ethnic Group X Age ; 
Ethnic Group X Sex 
Age X Sex 


1.60 
0.36 
0.02 
1.26 


5 
2 
2 
1 


0.32 
0.18 
0.01 
' 1.26 


0.60 
. 0.33 
0.01 
2. .37 


Explained 


161.22 


10 


16,12 


30.25*** 


Error 


317.54 


596 


- 0.53 




Total 


478.76 


606 


.0.79 





< .05 

**£ < .01 

< .001 



There was no significant difference between overall mean 
pretest and posttest scores on attitudes toward math, t (589) =* 
.53, £ > .05. In addition, three-way analysis of covariance 
on these mean gain scores (see Table 4.9 below) revealed no 
significant differences among ethnic groups, age groups, and 
sexes; -and no significant two-way interactions between these 
main effects (p > .05 for all main effects and interactions). 
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Table 4.9 

Analysis of Covariance 
"Gain Scores, Student At titu des Toward Math 



Source of Variation 


SS 


d£ 


MS 


■ F ' 


Covariate 

Pretest Score 


977 97 


1 


277 27 


111.66*** 


Main Effects 
Ethnic Group 
Age 
Sex 


12.22 
6.60 
2.19- 
3.95 


4 
2 
1 
1 


3.06 
3. ,30 
2.19 
3.95 


1.23 
1.33 
0.88 
1.59 


Two-Way Interactions 
Ethnic Group X Age 
Ethnic Group X Sex 
Age X,Sex 


5.72 
0.28 
5.58 
0.06 


5 
2 
2 
1 


1.14 
0.14 
2.J9 
0.06 


0.46 
0.05 
1.12 
0.02 


Explained 


295.21. 


10 


29.52 


11.90*** 


Error . . 


1433.91 


579 


2.48 




Total 


1.729.12 


589 


2.94 





< .05 

< .01 
'p <.001 



The overall mean gain score (.46) on attitudes toward 
television programs on math was significant at the £ < ,001 
level, t^(592) = 5 •76. Three-way analysis of covariance on 
these mean gain scores (see Table 4,10 below) revealed signi- 
ficant differences (£ < ,05) among adjusted* mean gain scores 
for Black (.67) ,^ Latino (,42), and non- target (.19) , students, 
Scheffe pos-thoc analyses revealed that the difference between 
adjusted mean gain scores for Black and non-target students 
was significant (£ < .05); however, differences between Black 
and Latino students, and between Latino and non- target students 
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were not significant (£ > .05). There were no significant 

differences between age groups or between boys and girls 

(£ > .05). 

There.^ was. a significant (£ < .01), two-way interaction 
between ethnic group and age. Mean, gain scores for attitudes 
toward television programs on math were higher for older 
Black and Latino students (means = .91 and .33, resptectively) 
than for younger Black and Latino students (means = .45 and 
.25, respectively). However, mean gain scores were higher for 
younger (.50) than older, (.36) non-target students. 



Table 4,10 

Analysis of Covariance . 
' Gain Scores,- Student Attitudes Toward TV Programs on Math 



Source of Variation 


IS 


df 


MS ' 


F 


Covariate 

Pretest Score 


774.27 


1 


774.27 


318.00*** 


Main Effects 
Ethnic Group 
Age . ; 
Sex 


27.61 
21.12 
0.97 
4.89 


4 
2 
1 
1 


6.90 
10.56 
0.97 
4.89 


2.84* 
4.34* 
0.40 
2.01 


Two-Way Interactions 
Ethnic Group X Age 
Ethnic Group X Sex 
Age X Sex 


37.40 
28.30 
11.68 
. 0.43 


5 . 
2 
2 
1 


7.48 
14.15 
5.84 
0.43 


3.07** 
. 5.81** 
2.40 
0.18 


Explained 


839.28 


10 


83.93 


34.54*** 


Error 


1414.05 


582 


2.43 




Total . - 


2253.33 


.592 


3.81 




*p < .05 
**p< .01 

***£< .001 











46 



4. 19 



Student Attitude Subscale . Descriptive statistics 
for the Student Attitude Subscale scores are shown in Appen- 
dix' K, Table . 

Three-way analysis of variance (see Table A. 11) revealed 
significant differences (£ < .05) among mean Attitude Subscale 
scores for Black (76.4) , Latino (74.2), and non- target (72.40), 
students. Scheff^ posthoc analyses revealed that no difference 
between mean subscale scores for Black, Latino, and non-target 
students was significant (£ > .05). 

Mean Attitude Subscale scores were significantly higher . 
(£ < .01) for older (78.6) than younger (73.2) students. There 
was no significant difference (£ > .05) between Attitude Sub- 
scale scores for boys (73.1) and girls (75.6). There were 
no significant twoj-way interactions (£ > .05). 



Table 4.11 

r 

Analysis of Variance: Attitude Subscale 



Source of Variation 


ss 


df 


MS 


1 


Main Effects 
Ethnic Group 
Age 
Sex 


2858.48 
1331.74 
1350.04 
584.13 


4 
.2 
1 
1 


714.62 
665.87 
1350.04 
584.13 


4.38** 
4.08* 
8.26** 
3.58 


Two-Way Interactions 
Ethnic Group X Age 
Ethnic Group X Sex 
Age X Sex 


1677.42 
705.36 
626.22 
180.20 


5 
2 
2 
1 


335.48 
352.68 
313.11 
180.20 


2.05 
2.16 
1.92 
1.10 


Explained 


4535.91 


9 


503.99 


.3.09** 


Error 


51123.91 


313 


163.34 




Total 


55659.82 


322 , 


172.86 





Note , ri = 323= all students fpr whom complete data were available. 
*o < .05 
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Teacher Responses 

Pretest/Rosttest Comparisons , Rretest and posttest 
scores on the Teacher Semantic Differential, and their cor- 
related t^-test analyses are shown in Appendix L, Table 
L.l. - 

Rretest means on all three concepts (educational 
television, math, and television programs on math) were 
above 5.20 on a scale of 1*00 (least positive) to 7o00 
(most positive). 

While all of the pretest-posttest differences 
were in the expected positive direction, only the educa- 
tional television concept score increased significantly 
from pretest to posttest, t(33) = 2,72^ £ ^ .0,1. There 
were no significant pfetestrposttest differences on con- 
cept scores for math, t(33) =1.47, £ > .05; and tele- 
vision programs on math, t(33) ='1.37, £ > .05. 

Of ^ the 36 teachers who completed the open-ended . 
Teacher Opinion Form during pQSttesting, 31 (86%) described 
their overall opinion of the series, in positive tennso 
Teachers commented favorably on the following aspects of 
the series: cultural and sodial aspects (15 teachers); 
student appeal and general presentation (12); m^th content 
(10); and motivation toward math (8). (Some teachers 
commented on more than onec.area.). 

Teachers rated the, series most effective in relating 
math to real lif6 (10 teachers); presenting positive social 
:and cultural images (6); and introducing the- metric 
system (4) • ' V : , 

Thirteen teachers asked fo? more emphasis on basic 
math content . Four: teachers suggested that less emphasis 
be placed on the use of non-standard English. 
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Particular segments, rated eff (Active included: 
"Scoops' Place" (11 teachers); "City Flats" (10) ; ani- 
mation segments (9); "Math in the Street" (5); and 
"Browns tone" segments (3). 

Particular show segments rated ineffective included: 
"Math Fact" segments (11 teachers); historical segments 
(9) ; "Math in the Street" (5) ; and "Brownstone" segments 
(3). 

Comparison of Shows . Teacher Weekly Questionnaires 
for all eight weeks were completed by 27 teachers (69% of 
the total, sample) • Frequency ^ data and results of two-way, 
repeated ^measures analyses of variance (27 (teachers) X 8 
shows)) on items 37 and 38 are shown in Appendix L, Tables 
L.2 to L.5. 

The mean, score on teachers' rating of the overall 
presentation (item 38) was 3.0 on a scale of 1 (poor) to 

4 (outstanding). There was a significant difference among 
teachers' responses, F(26, 173) = 3.42, £ < .001. There 
was also a significant difference among shows, F(7, 173) = 
3.56, 2. .001. There was no significant linear tre^d 
over shows, F(l, 6) = .52, £ > .05. iScheffe posthoc 
analyses comparing the means on all shows pairwise revealed 
that no difference between means for any pair of shows was 
significant at the .05 level. 

The mean rating fdr educational effectiveness for 
the eight shows (item 37) was 77%* There was a signifi- 
cant teacher effect, F(26, 173) = 4.66, £ < .001. There 
were nb significant differences among the eight shows, 
F(7, 173) =1.68, £> .05; and no significant linear 
trend i F(l, 6) = ^M, £ > .05^ 

\ Frequency data and results of the ten two-way, 
repeated measures analyses of variance (27 teachers X 8 
shows) performed on the ten Teacher Weekly Questionnaire 
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subscaies are shown in Appendix Tables L,6 to,L,25. \ 
These results are siirmarized in Table 4.12, which presents \ 
F ratios, degrees of freedom, and levels of significance 
for teacher effect, show effect, and linear trend over 
shows; and overall means for each of the ten subscaies. 



Table 4.12 
Teacher Subscaies: Summary of Analyses 



Ratios 

Subscale M Teacher Show Linear Trend 

(df=(26,182)) (^=(7,182)) ( df = (1, 6)) 



Class Preparation 


43% 


2.97*** 


1.08 


.65 


Program Guide 


69% 


•7. 61*** 


1.58 


1.27 


Program Presentation 


77% 


10.42*** 


2.95** 


.40 


Language 


86% 


3,18*** 


1.20 


1.86 


Technical Reception 


75% 


4.11*** 


2^66* 


10.29** 


Student Attention 


84^ 


2.10** 


3.19*^* 


.44 


■Program Appeal- 


81% 


7.02*** 


2.89** 


.03 


Math Content 


75% . 


2.98*** 


2.08* 


.29 ■ 


Math Attitudes 


82% 


3.50*** 


1.18 


.26 


Social Attitudes . 


71% 


12.94*** 


3.00** 


.02 



*£ < .05 

**£ < .01 
***£ < .001. 



These analyses revealed a significant difference 
among teachers on all ten subscaies, as wfis expected. 
There were also significant differences among shows on the 



Program Presentation, Technical Reception, Student Atten- 
tion. Program Appeal, Math Content, and Social Attitudes 
Subscales.. There was a /significant linear "trend over^ 
shows only for the technical Reception Subscale; this 
* trend was positive. Scheffe posthoc analyses revealed that 
the only significant difference between shows on any sub* 
scale was the difference between Show C (48%)^ for which 
31% of classes had reported aud^-o or video reception 
problems, and'Show/H (.89%) on the Technical Reception 
Subscale. 



I 

SUMMARY AND CONCLUSIONS 



On the following pages, the major findings of the 
evaluation of the eight-show "Infinity Factory" mini- 
.series will be summarized. 

Attention 
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Overall attention for eight shows was very high 
(mean = 91,3%), Attention rates were higher for 
Shows A axxd B, dropped to the lowest point fo:^ Show C, 
then stabilized near the 90% level for the remaining 
shows , 

Despite significant differences found among the 
, eight shows, posthoc analyses revealed tKat there were 
no sig^Lf I rr.^it differences between individual shows • In 
addition, no significant linear trend over the eight 
shows was found. 

Student Appeal 

Overall ratings of appeal on all subscales (show over- 
all, "Brownstone" segments , "City Flats "Scoops ' Place," 
and animation segments) were very positive for all students, 
with all subscale ratings above 2.16 on a three-point 
rating scale. 

A significant downward linear trend was reported for 
all subscales (show overall, "Brownstone" segments, "City 
Flats," "Scoops' Place," and anitnatioil segments). Although 
statistically significant, these declines were quite small 
(less than 57o over eight shows for "City If'lats," "Scoops' 
Place," and animation segments, and less than 10% for the- 
shows overall and "Brownsjzone" segments) , and could be 
expected as the novelty of participating in a study and of 
watching a television show in school gradually wearis off 
over a period of time. ^ 



Black and Latino students had higher appeal scores 
for the show overall. "Brownstone" segments. "City Flats," 
and "Scoops' Place" than did non-target students. Of par- 
ticular interest is the finding that Black and Latino students 
appeal ratings for "Scoops ' Place" (featuring a Black cast) 
and "City Flats" (featuring a Latino cast ) were comparable. 

A significant two-way. interaction of ethnic group 
and sex was reported for \^show overall, "Brownstone" segments, _ 
and "City Flats." This intera.ction indicated that Latino 
and non- target girls had greater appeal scores for these 
segments than Latino and non-target boys. In contrast. 
Black boys had greater appeal scores for these same segments 
than Black girls. 

Appeal scores were comparable far younger and older 
students for the- show overall, "Brownstone" segments, 
"Scoops' Place," and animation .segments. However, appeal « 
scores for "City Flats" were g^^ter for younger students 
than for older students. * \ 

Appeal scores for the show overall, "Brownstone" 
segments, and "City Flats" were higher for girls than for 
boys while appeal ratings for "Scoops' Place" and animation 
segments were comparable for .both se'xes . 

Comprehension of Dramatic Story Line 

The overall mean percentage correct on the 24- item 
Comprehension Subscale (77.7%) was considere^i quite high. 
There were no differences among Comprehension Subscale - • 
^scores for Black, Latino, and non-target students. Com- . 
prehension Subscale scores of plder s evident s. were higher than 
those of younger students, as would be expected. Scpres 
were comparable for boys and girls. 

Knowledge of. Math Content ■ , ' , 

Black, Latino, and non- target students^^ pejTEomed . 
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comparably on l:he Math, Content Pretest.. Score? were signi- 
ficantly higher for older than younger students , and 
significantly higher for boys than for girls. 

All student groups showed significantly improved 
scores on the math\content posttest after eight programs. 
The mean gain for all students on the Math Content Pre- 
test/Posttest was 3.1; the mean score on the Math Content 
Stabscale was 73*8%. \ 

Both gain scores and;Math Content Subscale scores 

\ . ? ■ ■ ' I 

were significantly greater for non- target than Black and- 
Latino students. There was an interaction between ethnic 
group* and sex gain scores: while gain scores were greater 
for Black and non- target girls than Black and non- target 
boys, Latino boys showed gi^eater gains than Latino ^ girls , 

Both gain scores and subscale scores on knowledge of 
math content were" cqifiparabl^ for boys and girls. 

Of par^ticular note are the findings tfhat ail student 
groups showed significant gains on -both measures of know- 
ledge of math content, and tHat non- target students' 
benefitted substantiallj^ from witching these television 
■ , programs which feature Black and Latfnq characters. 

v» ■ . > ■ ■ * . " 

* . . '. - ' ' ' . ' 

Student 'Atit^tudes > , 

' T^e overall mean gain on the 14- item pretest/posttest 
on socia\L and math attzitudes related to series goals was sig- 
nifi<:ant at^ the £ < ;00r level. Black students had signifi- 
cantly greater scores thjjn non-target students, while there 
were no, signiiicant differences between Black and Latino stu- 
dents and he twe'en. Latino and non-tsErget students. There were 
•0 no ethnic, group differences found on the Attitude Subscale. 
* There were no significant age differences found 
« " between the gain scores on the 14-item social ^and math \ 
attitude measxire. However , oldeij students had signifi- 
cantly greater scores on the Attitude Subscale than younger 
students.. . • • 
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Girls had significantly greater scores than boys oh 
the 14- item social ana math attitudes measure. However, there 
were no significant sex.differences on the Attitude Subscile. 

There were no S3|.gnif leant differences between overall 
mean pretest_and posttest scores on measures of attitudes toward 
televis_ion and attitudes toward math. In addition, there were 
no significant dijEferences among ethriic groups, age groups, 

and sexes oh these measures. \ 

• 1 \ 

The overall mean j gain on ;the pretest/posttest measure 
of attitudes toward television programs about math was sig- 
nificant at the £ < .001 level. Black students had signi- 
ficantly greater gain scores thaArion- target students, while 
there Vere no significant differences between Black and 
Latino and between Latino and non-l:arget students. There., 
were no significant age or sex differences found on this/ 
measure^ 

Of particular note are the findings that there were 
significant overall' gains from pretest to posttest on measures 
of social and math attitudes related to series gpals, and on 
attitudes toward television programs on math. On the whole, 
however, attitudinal gains from pretest to postt^p'st were not as 
great as those found on kn5wl.edge of math content. In addi-, 
tionV findings were not as dramatically positive aa those 
found on attention, appeals comprehension, arid teacher respon- 
ses. This result may be due in part"~to the difficulty of / 
.changing attitudes and of measuring that change, after only 
eight programs. j 

Teacher Responses . 

There was a signitieant positive change in teacher 
attitudes toward educatioftal television . as measured by a 
semantic differential onj tti^at concept. This finding 
suggests that teachers f,bund their experience with the 
."Infinity Factory" eight- show series to be a positive one. 
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Teachers' responses on the Teacher Weekly Questionnaire 
were generally positive; mean scores were above 707o for all 
subscales except the Class Preparation Sub-scale (mean - 43%). 
While there were significant differences among shows on six 
subscales (Presentation, Technical Reception, Student Atten- 
tion, Program Appeal, Math Content, and Social Attitudes) , 
wnens snows ^'were compared paxrwxse on cne axxrerence Detween 
Show C (low) and Show H (high) on the Technical Reception 
Subscale was significant. ..In addition, the only significant 
linear tr^nd over shows was a positive trend for the Technical 
Receptiot^' Subscale. 

At: the end of the eight-week evaluation period, 867o 
of the 3i6 teachers responding to the open-ended opinion form 
described their overall opinion of the series as positive. 
Specific aspects of the programs which received favorable 
commentrs were: 

/ -- cultural and social aspects (42%) ; 

— effectiveness of the program in motivating 
students toward math and relating math to 
real life (44%) ; 

cultural and social aspects of the program 
(42%); 

-- student appeal and program presentation (33%)^; and 
; math content (28%). \ 
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While 28% commented favorably about the math 
iohtent;i 36% commented that there should be more math 
eoiitent: or a fuller development of math content. In 
ge(jier^4, the level of math content was tons id^ed more 
appropriate~~by teachers of younger thain older students. 

.■^ . . ■ ■ ■■ ■ ^ ■ \ 

Two factors should be considered in interpreting 
the/teachers' responses to the programs ,1 particularly the 
ing that in general teache^rs considered the programs 
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more effective in motivating students toward mauh and 
relating math to real life than they did in presenting 
math content. First, the programs are designed for home ' 
viewing, as well as classroom use., and a lower density of 
math content may be necessary in order to compete for 
the home viewing audience. Second, the programs are designed 
principally to introduce math topics, show their rele- 
vance, and raise students' interest in math; they were not 
designed to be a complete instructional package. It is 
expected that teachers would be able to develop and carry 
out further instructional activities which would capital- 
ize on the interest developed by the television programs 
and complete, the learning process which the programs helped 
begin. 

Concliisions 

Results of the evaluation study support the conclu- 
sions that the "Infinity Factory"-prbgrams are able to 
capture and hold students' attention; that the programs have 
high appeal for Black, Latino, and non-target students; that 
the mathematical objectives of the series were generally met 
for all student groups; and that teachers consider the pro- 
grams effective and useful.- 

.Significant o^>^rall improvements were found in two 
of the four areas of students ' attitudes measured (social 
and math attitudes relakd to series goals, and attitudes 
toward television programVabout math). On the whole, how- 
ever, results in the areas d£ student attitudes were not as 
dramatically positive as resulXs in the areas of knowledge 
of math content, student attention. . and student appeal. 
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6 . RECOMMENDATIONS* 



The "Infinity Factory" eight-show series was evalua- 
ted with over 1,000 students in Boston, Massachusetts; 
Lawrence, Massachusetts; New York, New York; and Los Angfeles, 
California. The program series met with overall success as 
determined by measures of attention, appeal, comprehension, 
knowledge of math content, students' attitudes, and teacher 
responses. The following recommendations are made for 
distribution of the series, use in schools, ongoing produc- 
tion, and ongoing evaluation. 

1. Dissemination efforts should stress the 
advantages of the series for a non- target 
audience as well as the target audience since 
evaluation findings indicate that non- target 
students liked the program and benefitted from 
math content presented in a multicultural con- 
text. 

2. Dissemination efforts aimed toward schools 
sh^ould include more extensive orientation 
for teachers , with particular emphasis on the 
series' objectives (both math and cultural/ 
sociai) , the rationale for the series, and 
how the television programs and program guides 
can be used more effectively in schools. 

3. The program guides should include more ways to 
develop positive social, cultural, and math 
attitudes in a classroom setting since many 
teachers rated' the program very high in these 
areas but focussed mainly on math content in 
related classroom activities they conducted. 



These recommendations are based on the findings of both Part I and Part II 
of the evaluation study, and on the experiences of the evaluators in con- 
ducting the study. The recommendations are also included -as Section 13 
of Part I. 
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4. In ongoing production, special attention should 
be givien to defining both math and cultural/ 
social program objectives more clearly, and to 
carefully translating these objectives into 
program content- 
s' Since the historical and "Math in the Street" 
segments did not hold attention over the eight- 
show series, alternative presentation of the 
content in these sequences should be considered. 
Also, certain "Math Fact" segments were found to 
have low appeal for students, and alternatives 
for these should be considered. 1 

6. Evaluators found that show segments which I fea- 
ture Black or Latino families are well received 
by both Black and Latinov students. Therefore, 
this type of approach to multicultural iedufcation 
should be continued in future productions . \^ 

7. Since measures of appeal and comprehension of 
story line were quite high for the target au^di- 
ence and math content measures somewhat lower, 
it is suggested that one possible route to 
improving students* math learning might be a 

^ better integration of dramatic story line and 
math content . . 

8. Special attention should be paid to the diction 
of cast members- It is , recommended that the 
series use only actors who can be clearly under- 
stood by all segments of the target audience- 

9. The evaluation vfitidings indicate that younger 
and older students respond differently to the 
programs, especially in the areas of math con- 
tent, attitudes, and comprehension of story line. 
Therefore, special attention should be given to 
the development of material appropriate for spe- 
cific age groups, and each program should contain 
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material appropriate for different dge levels of 
the target audience. 

10. The purpose of some shorter segments of the shows 
was not clear to the evaluators. It is recommended 
that the educational objectives, both math and 
cultural/social, of these shorter segments be ^ 
planned and integrated into the context of the 
overall progT:g.TT)i^s carefully as the major segmetits. 

11. Ongoing conteiit analysis of programs should be 
implemented during production in order to monitor 
the degree to which each program segment meets 
its objectives. This information would also be 
useful to evaluators in developing items for/ 
criterion-referenced measures of program implact. 

12. More careful attention should be given to / 
relating programs and program segments to sjpe- 
cific cultural and social objectives of the series. 

13. Although the eight-show series was evaluated in 
the schools, the programs were designed primarily 
for home-viewing. Ongoing formative evaluation 
efforts should attempt to ex^.mine program impact 
in a non- school setting. 

14. A further examination of the effects of attention 
and appeal on comprehension, math attitudes, and 
knowledge of math content is recommended. 

15. Due to the ciombersome and time-consuming nature 
of a large-scale evaluation effort, more informal 
evaluation efforts are recommended with smaller 
groups of children. It- is further recommiended 

that this process be built into the program develop- 
menc process from the planning stages on, in order 
to^ provide ongoing and more immediate feedback 
throughout all phases of program development. 
16 > Greater time should be allowed for the develop- 
ment of evaluation measures so that more exten- 
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sive piloting procedures could be initiated, 
smaller- scale, ongoing evaluation recommended 
above would facilitate this process. Special 
attention should be given to the development 
measures of appeal and attitudes, which are 
especially difficult to measure. 
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